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Abstract: We give the distribution of M n , the maximum of a sequence of n observations from a 
moving average of order 1. Solutions are first given in terms of repeated integrals and then for the 
case where the underlying independent random variables are discrete. A solution appropriate for 
' large n takes the form 

on : i 

Prob(M n < x) = Y^Pj* "jx « B x rlt 
i=i 

where {vj x } are the eigenvalues of a certain matrix, r\ x is the maximum magnitude of the eigen- 
values, and / depends on the number of possible values of the underlying random variables. The 
eigenvalues do not depend on x only on its range. 

> 

^ . 1 Introduction and summary 



(N 
in 
o 



We give the distribution of the maximum of a moving average of order 1 for discrete random 
variables. 

Section 2 summarises results for any moving average of order 1 (discrete or not) given in Withers 
and Nadarajah (2009). Two forms are given for the distribution of the maximum. Only one of 
these is appropriate for large n. This form can be viewed as a large deviation expansion. It assumes 
that a related parameter v n can be written as a weighted sum of nth powers. 

Section 3 gives 3 sets of situation of increasing generality where this last assumption holds. 

Let {ei} be independent and identically distributed random variables from some distribution F 
on R. Consider the moving average of order 1, 

Xi = a + pet-i 

where p ^ 0. So the observations take the values {xi + pxj}. In Withers and Nadarajah (2009) we 
gave expressions for the distribution of the maximum 

M n = max Xi 
i=i 
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in terms of repeated integrals. This was obtained via the recurrence relationship 

G n (y) = /(p<0)G n _i(oo)F(y)+/CG n _i(y) (1.1) 

where G n (y) = Prob{M n < x, e n < y), (1.2) 

1(A) = 1 or for A true or false, and 1C is the integral operator 

ry 

JCr(y) = sign(p) / r((x — w)/p)dF(w). (1-3) 



For this to work at n = 1, define 

M = -oo so that G Q (y) = F(y). 

Note that dependence on x is suppressed. 
Our purpose is to find 

u n = Prob(M n <x) = G n (oo), n>0. 

Section 2 summarises and extends relevant results in Withers and Nadarajah (2009). 

In Section 3 we consider the case where e\ is discrete and derive a solution of the form given in 
the abstract. 

Section 4 gives a solution to G n of (|1.2j) . For any integrable function r, set J r = J r(y)dy = 
IZo r (v) d y> I X r = F r (v)dy = 11^ r(y)dy. 

2 Solutions using repeated integrals and sums of powers. 

Set 

v n = [K n F{y)] y=oa . (2.1) 

For example 

VQ = 1, Vl = - J F(z)dF(x - pz) = -I(p < 0) + J F{x - pz)dF(z). (2.2) 
The case p > 0. (jl.ip has solution 

G n (y) =!C n F(y), n>0, (2.3) 

so that 

u n = v n , n > 0. (2.4) 

For example no = 1. (The marginal distribution of X\ is u\ = v\ given by (|2.2p .) 
The case p< 0. By (JTTT]) for n > 0, 

G n +i(y) = u n F(y) +KGn{y) 

= a n (y) <g> u n + a n+ i(y) (2.5) 

n 

where aj(y) = JCF(y), a n <8> b n = ^ ajb n ~j. (2.6) 

j=0 
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Putting y = oo, u n is given by the recurrence equation 

u = v = 1, u n+ i = v n+ i + u n ®v n , n> 0. (2.7) 
(The marginal distribution of X% is u\ = 1 + v\ of (|2.2p .) The solution of (|2.7p is 

u n = S n+ i(it;), n > where w n = v n -i (2.8) 
and B n (w) is the complete ordinary Bell polynomial, a function of (w\, ■ ■ ■ ,w n ) generated by 

oo oo 
n=l n=0 

So {u n -i} have generating function 

oo oo 

tU(t) = (1 - ty(t)) -1 - 1 where I7(t) = ^ u n t n , V(t) = ^ u ft t ft . (2.9) 

n=0 n=0 

For example since vq = 1, reading from a table gives 

u = 1, u\ = vi + 1 
«2 = ^2 + 2ui + 1, 

^3 = ^3 + (2^2 + «l) + 3«i + 1, 

u A = U4 + (2u3 + 2u a u 2 ) + (3u2 + 3u?)+4w 1 + l. (2.10) 

For n n up to n = 9 and more details on computing B n {w), see Withers and Nadarajah (2009). 
Note that 1 > u n = Prob{M n < x) > u n +i > so that 

u n = => u n+ i = 0. (2.11) 

The solution (|2.8p gives no indication of the behaviour of u n for large n. In Section 3 we shall see 
that we can usually write v n as a weighted sum of powers, say 

I 

v n = Y^ Pj^j' 1 for n > n o (2-12) 
3=1 

where 1 < / < oo, no > 0. We call this the weighted-sum-of-powers assumption. In this case u n 
generally has the form 

J 

u n = y^7jffi for n > max(0, 2hq — 1) where J < I' = I + tiq, (2.13) 
3=1 

and {5j} are the roots of 
I 

Yl W~V(<* - vk) = P m (S) where p n+l (S) = 5 n+1 -v n ®6 n : (2.14) 

k=l 

Po(S) = 1, pi(6) =5-1, p 2 (S) =5 2 - 5-vi, p 3 (S) = 5 3 - 5 2 - 5v x - v 2 , ■■■ 

So (|2.14p can be written as a polynomial in 5 of degree J where J < I'. 
Case 1: Assume that these J roots are all distinct. 
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Having found {5j} , {7^} are the roots of 
J 

y~] Ajn (vhj = qno(y) for 1/ = z/i, • • • , vi (2.15) 

i=i 

where A jn (v) = $j/(6j - v), q n+ \(v) = u n+l + u n ®5 n : 

qo(y) = 1, q\ (u) = v + 1, q%{y) = v 2 + v + uj, (73 (z/) = z; 3 + z/ 2 + uii/ + u 2 , • • • 

(|2.15p can be written 

Anol = Qn where (A n ) kj = Aj n (v k ), Q n = (Qni, ■■■ , Qni'Y, Qnk = q n {vk)- (2.16) 
So if J = /, a solution is 

l = A~lQ no . (2.17) 

(If / = 00, numerical solutions can be found by truncating the infinite matrix A n and infinite 
vectors (Qn, 7) to N x N matrix and N- vectors, then increasing TV" until the desired precision is 
reached.) The proof, which is by substitution, assumes that {5j, za} are all distinct. The proof relies 
on the fact that if ]C/=i °j r j = for 1 < n < J and t\, ■ ■ ■ ,rj are distinct, then a\ = • • • = aj = 0, 
since det(r™ : 1 < n, j < J) 7^ 0. f|2. 13j) extends a corresponding result in Withers and Nadarajah 
(2009a). (If J < /, a solution is given by dropping I — J rows of (|2. 16j) . If J > I, there are not 
enough equations for a solution, and the 2nd method below needs to be used.) 

The values of u n for n < 2no — 1 can be found from (12. 7j) or (|2.8j) or the extension of (|2.10j) . 

Behaviour for large n. If (|2.12p holds then 

v n Br™ as n — > 00 where i? = ^{/^"V^™ : = n}, 

j 

ri = maxj =1 jz^l, z/j = rje lSj . A similar result holds for ti ra of (|2.13p . Withers and Nadarajah 
(2009b) give a 2nd method of solution based on (|2.9p . that applies even when the weights f3j in 
(|2.12p are polynomials in n. 

3 The discrete case. 

Suppose that e% is a discrete random variable, say 

ei = Xj with probability Pi > for i = 1, 2, • • • , P where 1 < P < cxd 

and Ym=iPi = 1- We do not need to assume that x\ < X2 < ■ ■ ■ ■ (The method extends in an 
obvious way for i = ■ ■ ■ , —1, 0, 1, 2, • • • where X^S-oo Pi = -*-•) 

So the observations X%, • • • , X ra take their values from the lattice {xi + pXj, 1 < i, j < P}. Set 
1(A) = 1 or for A true or false. The main task of this section is to give three increasingly general 
situations where the weighted-sum-of-powers assumption (|2.12p holds. For any function H, set 

AiH = sign(p) pi H((x - Xi)/p), A H = (A 1H , ■■■ , A PH )', 

qi{y) = l{xi < y), q{y) = (qi{y), ■■■ , qp(y)Y, 

Qij = sign(p) qi((x - Xj)/p) pj, Q = [Qij : 1 < i, j < P). (3.1) 
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(Recall that dependence on x is suppressed.) For example 

Q12 sign(p) = I(xi <(x- x 2 )/p) 

= 1 p > 0, x > X2 + px\ or p < 0, x < X2 + px\. 

Note that 

KH(y) = A' H q(y), Kq{y) = Qq(y), K, n H{y) = A! H Q n - x q{y) for n > 1. 
So t>o = 1 and for n>l,v n of (|2.1|) is given by 

v n = A'pQ^l, where 1' = (1, • • • , 1). (3.2) 
In terms of the backward operator B defined by 

By n = y n _i, 

the recurrence relation (|2.7p can be written for n > 0, 

u n+1 = v n+1 + C n u n where C n = I P + ^£ n l, £ n = (J P - Q n B n )/{I P - QB), (3.3) 

where ip is the P x P identity matrix. So #0 = 0. 
Alternatively, from (|2.10p we have 

ui = 1 + A' F 1, 

u 2 = 1 + A' F {2I + Q)l, 

u 3 = 1 + {A' F 1) 2 + A' F (3I + 2Q + Q 2 )l, 

u 4 = l + 3(^l) 2 + 2(^l)(vl^Ql) + ^(4/ + 3Q + 2Q 2 + Q 3 )l, 

and so on. Neither solution is satisfactory for large n. 

The idempotent case. We shall see that Q frequently has the form 

Q = 9J where 9 is scalar and J 2 = J. (3-4) 



That is, J is idempotent with eigenvalues 0, 1. By 

vi = A' F 1, v n = n ~ l d for n > 2 where d = A' F J1. (3.5) 

This is just (I2TT2D with 1 = 1, n = 2, v x = 9, fa = d/6. By (1XT31 a solution is 

3 

u n = n>3 

where {5j, j = 1,2,3} are the roots of 

5 3 - (9 + 1)<5 2 + {9- Vl )5 + (vi -d)9 = 

and for A 2 ,Q 2 of (12TTB1) . 

(71,72,73)' = ^2 1( 52- 

An explicit solution to a cubic is given in Section 3.8.2 pl7 of Abramowitz and Stegun (1964). 



Example 3.1 Suppose that e\ takes only two values, say and 1. Then the observations take the 
values 0, 1, p, 1 + p and 

Q-sian(o) (^<x/p)pi, 1(0 < (x -l)/p)p 2 
y-sign{p) y i{1 < x/p)p ^ /(1 < {x _ 1)/p)p2 

The possible values of Q are ±Qi, 1 < i < 8, where 



For i = 1,3, 5, 6, 7 and Q = Qi, \3.$ holds with 9 = 0j, Jj = Qi/Oi, 9\ = 1, # 3 = p\, #5 = p 2 , 9$ = 
9 7 =p\. Also |ggp /10/ds wii/i 9 = for Q 4 . 

There are four cases of p to consider. 

The case /? < — 1 : T/ie observations take the values p<l + p<Q<l. Q changes at these 
values of x. 

As x increases through x < p, p < x < 1 + p,l + p < x < 0,0 < x < 1 and 1 < x, Q changes from 
—Qi to —Q 2 to —Qs to —Q4 to 0. 

The case — 1 < p < : The the observations take the values p<0<l + p<l. As x increases 
through x < p, p < x < 0, < x < 1 + p, 1 + p < x < 1 and 1 < x, Q changes from —Q\ to —Q2 
to —Q5 to —Qi to 0. 

The case < p < 1 : the observations take the values 0<p<l<l + p. As x increases through 
x < 0,0 < x < p, p < x < 1,1 < x < 1 + p,l + p < x, Q changes from to Qe to Qj to Qs to Q±. 

The case 1 < p : The observations take the values 0<l<p<l + p. As x increases through 
x < 0,0 < x < 1, 1 < x < p, p<x<l + p,l + p<x,Q changes from to Qq to Q3 to Qs to Q\. 

Consider the case < p < 1. So A^/Pi jumps from to p\ to 1 at Xi + px\ = Xj and Xj + px 2 = 
Xi + p. Then there are 5 ranges of x to consider. 

x < => Q = 0, (Qyj holds with J = 0, 9 = 0, A F = 0, d = 0, u n = v n = for n > 1. 

< x < p ft3.4\ ) holds with Q = Q 6 , 9 = p 1 ,J = Q^) , A F = pip, d = pi, u n = v n = for 
n > 1. 

p < x < 1 (33) holds with Q = Q 7 , 9 = p 1 ,J = (}°) , A F = p x (J) , d = p\ , u n = v n = p\ for 
n > 1. 

1 < x < 1 + p => Q = Q 8 , A F =pi ( M , but \34\ l does not hold. 

1 + p < x =4> ( fg.^l j holds with 9 = 1, Q = J = Q\, Ap = p, d = 1, u n = v n = 1 for n > 0. 

Now suppose that p < 0. Then for i = 1,3,5,6,7, Q = —Qi = 9. L Ji where 9\ = —1, #3 = 
—Pi, #5 = —P2, Gq = 9-j = —p\. Again, this deals with all cases except for Q 2 ,Qa,Q%. 

Also Q\ = so that for Q = ±Q$, v n = for n > 2. For 1 + p < x < 1, Ap = (0, —P1P2)', v\ = 
-P1P2, V(t) = 1 - pip 2 t. So by iTOj) . tU(t) = D- 1 - 1 where D = 1 - tV(t) = (1 - Pl t)(l - p 2 t), 
giving 

Un = {p n 1 +2 -P2 +2 )/(Pl-P2) 

for p\ 7^ 1/2. So for p\ = 1/2, u n = (n/2 + l)2 _n . This illustrates our second and most general 
method of solution, the use of \2. 9\) . 

Finally, the cases Q 2 and Qs can be dealt with by the following method. 
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Our third solution is in terms of the eigenvalues and left and right eigenvectors of Q, say {i/j, k, Ti : 
1 < i < P}. 

The case of diagonal Jordan form (for example distinct eigenvalues). 

In this case the P x P matrix Q has Jordan canonical form 

p 

Q = RAR^ 1 = RAL' = V] iW-, RL' = I P , A = diag{v\,- ■ ■ ,vp), L = (h, ■ ■ ■ ,l P ), R = (n, • • • ,r P ) 

i=i 

Then by ((32]) 



Q n = L'A n R = Vinl'i for n > 0, 
i=i 

p 

K n H{y) = Y, bMvK' 1 forn > 1 where b lH (y) = (A' H n) (&q(y)), (3.6) 
i=l 
P 

v n = Yl ^i' 1 for n > 1 where A = Moo) = (4^) $1). (3.7) 



1=1 



So (I2J2D holds with I = P, n = 1. So for n > 1, if p > 0, then u n = v n of ((321), and by (|233j> . if 
p < 0, then 



P+l 



i=i 

where {<5j} are the roots of 

p 

A^/ (<y — i/fc) = 5 — 1 

k=l 

and 7 is given by (|2.17p . So this method requires computing the left and right eigenvectors of Q 
for its non-zero eigenvalues. In rare cases Q is symmetric so that L = R. 

One can show that this method agrees with the idempotent method when are both applicable. 

Example 3.2 Let us reconsider the previous example. 
Firstly, suppose that < p < 1. We consider 3 cases. 

The case < x < p: Then Q = Qq has eigenvalues pi,0. For v = p%, I = r = ( ). So for 
n > 1, Q n = p™ll' in agreement with the idempotent method. 

The case p < x < 1: Then Q = Q-j has eigenvalues 0,pi. For v = pi, we can take I = ( Q ), r = 
(,). So for n > 1, Q n = lr'p\ in agreement with the idempotent method. 

The case 1 < x < 1 + p: Then Q = Qs has eigenvalues satisfying v 2 — p\v — P1P2 = so 
that 2vi = pi± (pi + 4pip 2 ) 1/2 - Take r* = k = Q£)/cj w/iere q = + 2p 2 )- Casing 

+ ^2 = Pi 5 ^1^2 = —P1P2, we obtain 



Q n = Y»H 
1=1 ^ 



vm vivi 
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Also A' F = pi(l,p 2 ). So one obtains 
2 

forn>l where /% = 04 /{vi + 2p 2 ), en = (1 + pip 2 )z/j + pip 2 (l +Pi)- 



2 

v„ 

i=i 



Secondly, suppose that — 1 < p < x < 0. Then A' F = — (pf,p 2 ). Suppose that p\ 7^ 1/2. Then 
Q = —Q2, Q2 = RAL' where A = diag(p\,p 2 ), 

p ( l P2 \ T , p-l fl ~P2(P2 -pi)) -1 \ / n yn _ T, X nrf _ [Pi P2a n \ 

R= {o p 2 - Pl )' L=R ={o (P2-P1)- 1 )' { - Q) ~ RAL -\o p%) 

where a n = (p? - p£)/(pi - p 2 ). So by v n = (-l) n a n+2 . So 1 + tU(t) = (1 - tV{t))- 1 = 

(1 — v\t){l — v 2 t) = 1 + t + pip 2 t 2 giving u\ = pip 2 , u n = for n > 2. 

If Pi = 1/2, then by a limiting argument, v n = (— 2)~ n (n + 2)/2 for n > 0, U\ = 1/4, u n = for 
n>2. 

Example 3.3 Suppose that &\ takes the 3 values 0, 1, 2. So the observations take the values 
0, 1, 2,p, 1 + p, 2 + p, 2p, 1 + 2/3, 2 + 2p and 

[l(0<x/p)p h I(0<(x-l)/p)p2 /(0 < (x - 2)/p)p 3 N 
Q = sign(p) il(l<x/p) Pl , 1(1 < (x - l)/p)p 2 1(1 < {x - 2)/p)p 3 
\l(2<x/p) Pl , I(2<(x-l)/p)p 2 7(2 < (x - 2)/p)p 3 , 

Suppose that < p < 1/2. Then Q changes each time x crosses one of the nine values < p < 
2p < 1 < 1 + p < 1 + 2p < 2 < 2 + p < 2 + 2p. So we need to consider ten cases, six of them 
idempotent. The possible values of Q are ±Qj,0 < i < 9 where Qq = 0, 

(1 0\ (1 0\ /l N 

Qi = w , Q 2 = 2 Pl 1 /2, Q 3 = P3 1 
\0 0/ \0 0/ \1 0, 

M p 2 0\ 

Q 4 = Pi , Q 5 
\Pi 0/ 

/Pi P2 P3 N 

Q7 = Pi P2 I , Qi 

\Pl P2 

^4/so Qo = Qi/Qi ar e idempotent for i = 1,2, 3, 6, 9 where 

01 = 03= Pi, 02 = 2pi, 6 = Pi + P2, 09 



(Pi 


P2 


o^ 




(Pi 


P2 




Pi 


P2 





, Qe = 


Pi 


P2 




\P1 





oj 




\pi 


P2 





(Pi 


P2 


P3) 




I Pi 


Pi 


Pi\ 


Pi 


P2 


PZ 


, Q9 = 


Pi 


Pi 


P3 


\Pl 


P2 






\pl 


P2 


Pi 



Case 1 
Case 2 
Case 3 



x < Q = 0, Ap = 0, v n = for n > 1. 

0<x<p=>Q = Qi, A' F = (pf,0,0), d = pi v n =p™ +1 /orn > 1. 
p < x < 2p^ Q = Q 2 , A' F = (pi(pi +p 2 ),0,0), d = Pl (px +p 2 )/2, 

^1 = +P2), ^„ = (2pi) n_1 d /or n > 2. 



Case 4: 2p < x < 1 => Q = Q 3 , A' F = (pi,0,0), v n = p" /orn > 1. 
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Case 5: \<x<l + p=?Q = Q^. Q± has distinct eigenvalues 

0, v 2 = (pi + e)/2, i/ 3 = (pi - e)/2 w/iere e= (p\ + 4pip 2 ) 1/2 . 

Also 

A' F = (pi,PiP2,0), 
2s r' 2 = (pi + e, 2pi, 2pi) = S e say, 2p 1 l' 2 = (2p 1 , -p 1 + e, 0) = C £ say, 
2e r' 3 = -B. e , 2 Pl l' 3 = C. £ . 

So by Q ; for n > 1, v n = Ei=2 ^re 

/?2 = Pib £ Cel (4e), /3 3 = -pi0_ e c_ E /(4e) w/iere 6 e = pi + 2pip 2 + e, c £ = 2p x - p x p 2 + p 2 e. 

Case 6: 1 + p < x < 1 + 2p =^ Q = Q5. JTiis is i/ie on/?/ example here where the general Jordan 
form is needed. 

Case 7: l + 2p < x < 2 => Q = Qq = 11' = OqJq say, where I' = {pi,p 2 ,0),6e = P1+P2, Jq = Je- 
Also A' F = (pi,p 2 ,0). So by Q), v n = (pi +p 2 ) n for n > 1. 

Case 8: 2<x<2 + /9=>Q = Q7. Q7 has distinct eigenvalues 

0, ^2 = (pi + P2 + e)/2, f 3 = (pi + P2 - e)/2 w/iere e = ((pi + p 2 ) 2 + 4pip 3 ) 1/2 . 

Also 

A'p = {pi,P2,PlP3), 

2 Pl e r' 2 = (a B , b £ , b £ ) where a £ = pip 2 + 2pip 3 + p\ - p 2 e, b £ = p 1 (p 1 + p 2 - e), 
2piP3 1' 2 = (pic £ ,p 2 c £ , 2pip 3 ) where c £ =pi+p 2 + e, 
2pi£ r' 3 = (-a_ e ,6_ e ,6_ £ ), 2pip 3 l' 3 = (pic_ e , p 2 c_ e , 2pip 3 ), 

so f/iai ( pHP forn>l, v n = Ya=2 where 

fa = B 2£ C £ /{4p 2 m e), fo = B ?J _ £ C- £ /{4p 2 m e), 
w/iere B 2e = p x a £ + (p 2 + pip 3 )6 e , £ 3 - £ = -pia_ £ + (p 2 + pip 3 )6_ E , 
C £ = (Pi + P2K + 2pip 3 . 

Case 9: 2 + p < x < 2 + 2p Q = Q%. Q$ has distinct eigenvalues 

0,^2 = (pi+P2 + e)/2, u 3 = (p 1 +p 2 -e)/2 where s = 5 1/2 , 5 = (pi +p 2 )(pi +P2 + 4p 3 = l + 3p 3 ). 
5y Q for n > 1, v n = £i= 2 ftz/J 1-1 w/tere 

= {Pl,P2,P3{Pl +P2)), 

2(pi+p 2 )er 2 = (pi(pi +p 2 + e), pi(pi +p 2 + e), pi) = B £ say, 

2pi / 2 = (2pi, 2p 2 , -pi -p 2 + e) = C £ say, 
2(pi +p 2 )e r 3 = -£_ £ , 2p! / 3 = C. £ . 

Case 10: 2 + 2p < x => Q = Qg. As noted, Jgg] ZioWs wft #9 = 1. Also QqI = 1, A' F = 
(0,0,p 3 ),d = p 3 . So fry £OP, « n =P3 /or ra > 1. 

77ns leaves only Q5 io otea/. to// oe dealt with by the following method. 
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Our third and general solution is in terms of the eigenvalues and left and right generalized eigen- 
vectors of Q, say {z/j, Zj, r» : 1 < i < P}. 

The general Jordan form. 

The general Jordan canonical form for a q x q matrix Q is 

r 

Q = RAR- 1 = RAL' = Y,RiJmM) L l (3-8) 

i=i 

where = I, L = (L 1 , • • • ,L r ), R = • • • , i? r ), A = diag(J OT1 (i>i), • • • , J mr K)), 
and Lj, i?j are g x m*, 

= + u m , 

and t/ m is the m x m matrix with zeros everywhere except for ones on the diagonal above the 
leading diagonal: (C/ m )ij = 

Ji{v) = u, J 2 (u) = (^j, h(y) = U v I 

J m (u) has only one right eigenvector. The ith block in QR = RA is QRi = RiJ mi {vi). Taking its 
jth column gives 

Qnj = v^ij + r iJ+ll j = 1, • • • ,m, where r i>m . +1 = 

and Tij is a g-vector. So one first computes the right eigenvector ri >mi and then the generalized 
eigenvectors rj imi _i, • • • , rn recursively, the Jordan chain. For n > 0, the nth power of Q is 

min(n,m— 1) , . 

4W" = E (fc) ,/B ~* t &' (3-9) 

r r min(n,mj— 1) , . 

i=l i=l fc=0 ^ ' 

where W ifc = RiU^. 

where C/^ is the m x m matrix with zeros everywhere except for ones on the fcth super-diagonal: 
(^m)ij = $i,j-k- So C/™ = 0. So Q n is a matrix polynomial in n of degree m — 1 where m = 
max- =1 rrij, and by (j3.2|) . 



r min(n,m;)-l . . 

v ™ = E E ( n jfe ) v i~ X ~ kw ik forn > 1 where w ik = A' F W ik l. (3.11) 

i=l k=0 ^ ' 



For diagonal Jordan form this reduces to (|2.12p . This level of generality is not needed if the 
eigenvalues of the non-diagonal Jordan blocks are zero, since we can rewrite (|3.10p and (I3.1ip as 



min(n,m; — 1) . . 

E E {kn~ kWik+ S I(n<m t )W in , n>0, (3.12) 

<r, u t ^0 k=0 ^ ' l<i<r, ^i=0 

min(n,m;)-l . . 

E E [Z )<~ 1 ~ kw ik+ E /(n < miKn-i, n > 1.(3.13) 

<r, A.-0 ^ ' Kt<r. ^=0 
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The solution for u n is a weighted sum of nth powers where the weights are constants or polynomials 
in n: see Withers and Nadarajah (2009b) for details. 



Example 3.4 This continues Case 6 of Example 3.3. Set qi = Pi/(pi + P2)- By Appendix A, 113. 8\) 
holds for Q = Q5 with r = 2, mi = 2, rri2 = 1, v\ = 0, v 2 = p\ + p 2; 





(0 


<?2 ) 






Ri = 





-Qi 


, R2 = Ql 






\Q2 


-iV 




w 



4=(; - p :{ p2 1+p i/p2 ),l' 2 =(i P2/P1 0). 



Also J 2 (0) n = for n > 2. So 



P2 0^ 

Q n = (Pi + P2) n R2L' 2 = (pi + P2T- 1 I Pi P2 0| forn> 2. 




AZso = (pi,p 2 (pi+P2),0). So by (KM), 

v n = v n ~ l v\ for n > 1 where v = p\ + p 2 , «l = Pi + P2(pi + P2)- 

As noted, this is the only example here where the general Jordan form is needed. 
(It was implicit in the 2nd part of Example 3.2 for the case p\ = 1/2, but was bypassed by the 
limiting argument.) SoV{t) = l + v 1 t/{l-vt), 1 -tV(t) = L/(l - vt), L = (1 - t)(l - vt) - vrf 2 = 
(l-«i)(l-tt 2 ), t k = {iy+l±5^ 2 )/2, 5 = (u+l) 2 -A{u- Vl ) = pl+M, l+tU(t) = (1-tVit))- 1 = 
(1 - vt)/L = Y?k=i c fe/(! - ttk), c fe = (1 - v/t k )(l - t 3 - k /tk) giving for p < 0, 



1 = ^2c k t^, n > 1. 



k=l 

So although mi = 2, a sum of powers solution still holds. 

As noted for the diagonal form, Q and its eigenvectors only change value when x crosses one of the 
possible observation values, or equivalently when p crosses one of the set {(x — Xj)/xi, 1 < i,j < P}. 
If x is replaced by x n , then again Q and its eigenvalues do not depend on n or x n except through 
its range. 



For more on Jordan forms, see for example http : //en. wikipedia. org/wiki/ Jordan_normal_f orm 



Note 3.1 The singular values of J m (i / ) needed for its singular value decomposition, SVD, are 
quite different from its eigenvalues, which are all v. The SVD of Q gives an alternative form for 
its inverse, but is of no use in computing Q n . 

4 A solution for G n (y). 

A solution for G n (y) = Prob(M n < x, e n < y) may be of interest. 
If p > then a solution is given by f|2.3() : 

G n (y) = a n (y) where a n (y) = IC n F(y), n > 1, 
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Suppose that Q of (|3.1|) has diagonal Jordan form. Then by (|3.6p . 

p 

a n (y) = A! F Q n - l q{y) = J2 b ^(v) v i~ 1 where b iF {y) = (A! F n) (l' t q(y)) for n > 1. 

i=l 

Now suppose that p < 0. Then a solution is given by ([2.50 : 

GWi(y) = a n (y) u n + a n +l(y), » > 0. 
Also by Section 2, QZTgJ) holds with n = 1: 

r 

U n = X)^'^ -1 fOT ^ - 1 Where & = ^(°°) = (^ r *) 

i=i 

so that by (12TT31) 

u n = 7j<5™ for n > 1. 

Substituting we obtain using ([2.13[) . 

p r 

G n+1 (y) = 2^6, F (y)^- 1 -^ 7j c :; (y)^ +1 forn>l (4.1) 
i=i i=i 
p 

where Cj(y) = b iF (y)v^ 1 {u i - Sj)" 1 . (4.2) 
i=l 

So its behaviour for large n is determined by the Ui or Sj of largest modulus. 

A Appendix: a MAPLE program to find the Jordan form. 

Here is the MAPLE program used to work out the Jordan form for Q = Qs/pi in Example 3.4. It 
can easily be adapted to other examples. We set c = P2/P1, M = V . 

with(LinearAlgebra) ; 

Q:=Matrix(3,3, [[l.c.O] , [l.c.O] , [1,0,0]] ) ; 
JordanForm(Q) ; 



= JordanForm(Q , output='Q') ; 
=R~(-1); 

=simplify(M.Q.R) ; 



R 
M 
J 

quit ; 

The last line is just to confirm that Q = RJM. 
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